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Abstract: Continuous time random walks (CTRWs) are versatile models 
for anomalous diffusion processes that have found widespread application in 
the quantitative sciences. Their scaling limits are typically non-Markovian, 
and the computation of their finite-dimensional distributions is an impor- 
tant open problem. This paper develops a general semi-Markov theory for 
CTRW limit processes in R d with infinitely many particle jumps (renewals) 
in finite time intervals. The particle jumps and waiting times can be coupled 
and vary with space and time. By augmenting the state space to include the 
scaling limits of renewal times, a CTRW limit process can be embedded in 
a Markov process. Explicit analytic expressions for the transition kernels of 
these Markov processes are then derived, which allow the computation of all 
finite dimensional distributions for CTRW limits. Two examples illustrate 
the proposed method. 
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1. Introduction 

Continuous time random walks (CTRWs) assume a random waiting time be- 
tween each successive jump. They are used in physics to model a variety of 
anomalous diffusion processes (see Metzler and Klafter [32]), and have found 
applications in numerous other fields (see e.g. [5, 14, 35, 36]). The scaling limit 
of the CTRW is a time-changed Markov process in R d [29]. The clock process 
is the hitting time of an increasing Levy process, which is non-Markovian. The 
distribution of the scaling limit at one fixed time t is then usually calculated by 
solving a fractional Fokker-Planck equation [32], i.e. a governing equation that 
involves a fractional derivative in time. The analysis of the joint laws at multiple 
times, however, becomes much more complicated, since the limit process is not 
Markovian. In fact, the joint distribution of the CTRW limit at two or more 
different times has yet to be explicitly calculated, even in the simplest cases, see 
Baulc and Fricdrich [4] for further discussion. 
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The main motivation of this paper is to resolve this problem, and our ap- 
proach is to develop the semi-Markov theory for CTRW scaling limits. CTRWs 
are renewed after every jump. As it turns out, the discrete set of renewal times 
of CTRWs converges to a "regenerative set" in the scaling limit, which is not 
discrete and can be a random fractal or a random set of positive Lebesgue mea- 
sure. This regenerative set allows for the definition of the scaling limit of the 
previous and next renewal time after a time t. By incorporating these times 
into the state space, a CTRW limit can become Markovian. Although CTRW 
scaling limits have appeared in many applications throughout the literature, to 
our knowledge the renewal property has only been studied for a discrete CTRW. 
Moreover, CTRW limits are examples for possibly discontinuous semi-Markov 
processes with infinitely many renewals in finite time, and hence the devel- 
opment here complements the literature on continuous semi-Markov processes 
[12]. 

It is known [22] that semi-Markov processes can be constructed by assum- 
ing a Markov additive process (A U ,D U ) and defining X t = A(E t ), where E t 
is the hitting time of the level t by the process D u . With this procedure, one 
also constructs CTRW limit processes. However, such CTRW limits arc homo- 
geneous in time, and several applications require time-mhomogcncous CTRW 
limit processes [13, 25]. Hence we will assume that (A U ,D U ) is a diffusion process 
with jumps (such that D u is strictly increasing), modelling the cumulative sum 
of non-i.i.d. jumps and waiting times (see section 2) which vary with time and 
space. In this setting, we develop a semi-Markov theory for time-mhomogeneous 
CTRW limits. 

Coupled CTRW limits, for which waiting times and jumps are not indepen- 
dent, turn out to be particularly interesting. As recently discovered [38, 20], 
switching the order of waiting time and jump (i.e. jumps precede waiting times) 
yields a different scaling limit called the overshooting CTRW limit (OCTRW 
limit). The two processes can have completely different tail behavior [20] and 
hence provide versatile models for a variety of relaxation behaviors in statisti- 
cal physics [40]. Both CTRW and OCTRW limit turn out to be semi-Markov 
processes; however, incorporating the previous renewal time only renders the 
CTRW limit Markovian and not the OCTRW limit, and the opposite is true 
when the following renewal time is incorporated. In the uncoupled case, CTRW 
and OCTRW have the same limit, and hence both approaches yield Markov 
processes. 

This paper gives explicit formulae for the joint transition probabilities of 
the CTRW limit (resp. OCTRW limit), together with its previous renewal time 
(resp. following renewal time, see Section 3). These formulae facilitate the cal- 
culation of all finite-dimensional distributions for CTRW (and OCTRW) limits. 
The time-homogeneous case is discussed in Section 4. Finally, Section 5 provides 
some explicit examples, for problems of current interest in the physics literature. 
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2. Random walks in space-time 

A continuous time random walk (CTRW) is a random walk in space-time, with 
positive jumps in time. Let c > be a scaling parameter, and let 

n 

(S c n ,TZ) = (A c 0> D c ) + J2(Jk,WZ) 
fc=i 

denote a Markov chain on R d x [0, oo) that tracks the position S 1 ^ of a randomly 
selected particle after n jumps, and the time T£ the particle arrives at this 
position. The particle starts at position Aq at time Dg, Njr = max{fc > : Tj: < 
t} counts the number of jumps by time t, and the CTRW 

is the particle location at time t. The waiting times W£ are assumed positive, 
and when t < To we define N]r = 0. The process Njr is inverse to T£, in the 
sense that Nj, = n. Often the sequence (J£, W£) is assumed to be independent 
and identically distributed, which is the appropriate statistical physics model 
for particle motions in a heterogeneous medium whose properties are invariant 
over space and time. The dependence on the time scale c > facilitates tri- 
angular array convergence schemes, which lead to a variety of interesting limit 
processes [2, 3, 18, 30]. The CTRW is called uncoupled if the waiting time Wf. is 
independent of the jump JjF, see for example [23]. Coupled CTRW models have 
been applied in physics [32, 37] and finance [27, 34]. If the waiting times are i.i.d. 
and the jump distribution depends on the current position in space and time, 
the CTRW limit is a time-changed Markov process governed by a fractional 
Fokkcr-Planck equation [13]. A closely related model called the overshooting 
CTRW (OCTRW) is 

VC QC 

1 f — D N o + 1 , 

a particle model for which J\ is the random inital location, and each jump J}; is 
followed by the waiting time W£. See [19] for applications of OCTRW in finance, 
where Y t represents the price at the next available trading time. See [40] for an 
application of OCTRW to relaxation problems in physics. 

In statistical physics applications, it is useful to consider the diffusion limit of 
the (O)CTRW as the time scale c —> oo. To make this mathematically rigorous, 
let D([0, oo),R rf+1 ) denote the space of cadlag functions / : [0, oo) -> R d+1 with 
the Skorokhod J\ topology, and suppose 

[cu] 

(Sf cu] ,T[ cu] ) - {Al,DD +J2( J k,m) => (A U ,D U ), (2.1) 

fc=i 

where "=>" denotes the weak convergence of probability measures on D([0, oo), 
K d+1 ) as c — > oo. Suppose the limit process (A U ,D U ) is a canonical Feller 
process with state space in the sense of [33, III §2]. That is, we assume 
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a stochastic basis (fi, J 7 ^,, J- u , P X ' T ) in which f2 is the set of right-continuous 
paths in M. d+1 with left-limits and (A u (lu), D u (uj)) = ui(u) for all ui £ fi. The 
filtration T = {J- U }u>a is right continuous and (A U ,D U ) is ^-adapted. The laws 
{P x ' T }( x r ) gR d + i are determined by a Feller semigroup of transition operators 
(T u )u>o and are such that (A ,D ) = (x7 T ), P x,T -a.s. The cr-fields and 
J-"o are augmented by the P x ' r -null sets. Expectation with respect to P X,T is 
denoted by E X ' T . The map (x, t) t— !> E X ' T [Z] is Borel-measurable for every J 7 ^- 
measurable random variable Z. If the space-time jumps form an infinitesimal 
triangular array [28, Definition 3.2.1], then (A U ,D U ) — (Aq, Dq) is a Levy process 
[30]. In the uncoupled case, A u — Aq and D u — Dq arc independent Levy processes 
[29] . If the space-time jump distribution depends on the current position, it was 
argued in [13, 39] that the limiting process (A u , D u ) is a jump-diffusion in 
If (2.1) holds, and if 

the sample paths u i— > D u are P x ' r -a.s. strictly increasing and unbounded, 

(2.2) 

then [38, Theorem 3.6] implies that 

X c t =>- X t := {A Et -) + and Y t c =>- Y t := A Et in B([0, oo),R d ) as c oo, 

(2.3) 

where 

E t = inf{u > : D u > t} (2.4) 

is the first passage time of D u , so that Ed u = u. Then the inverse process (2.4) 
is defined on all of R and has a.s. continuous sample paths. The CTRW limit 
(CTRWL) process X t in (2.3) is obtained by evaluating the left-hand limit of 
the outer process A u _ at the point u = E t , and then modifying this process to 
be right-continuous. This changes the value of the process at time points t > 
such that u = Et is a jump point of the outer process A u , and Et+ e > Et for 
all e > 0. If A u and D u have no simultaneous jumps, then the CTRW limit 
X t equals the OCTRW limit Y t [38, Lem. 3.9]. However, these two processes 
can be quite different in the coupled case. For example, if Ji = WE form a 
triangular array in the domain of attraction of a stable subordinator D u , and if 
Ao = -Do = 0, then A u = D u , and X t = De ± - < t < D Et = Y t almost surely [6, 
Theorem III. 4]. See Example 5.4 for more details. 

We assume the Feller semigroup T u that governs the process (A U ,D U ) acts 
on the space Co(P rf+1 ) of continuous real- valued functions on M. d+1 that vanish 
at oo, and that it admits an infinitesimal generator A of jump-diffusion form [1, 
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Eq. (6.42)]. In light of (2.2), this generator takes the form 

d 

Af(x,t) =Y,Hx,t)d x J{x,t) + l(x,t)d t f(x,t) 
i=l 

+ \ Yj MM^^./OM) (2.5) 

<i,j<d 

d 

fix + y,t + w)- f(x, t) - ^ hi(y, w)d x J(x, t) 



+ 



K(x, t; dy, dw) 



where (x,t) G R d+1 , bi and 7 are real- valued functions, and A = (a^) is a func- 
tion taking values in the non-negative definite dxd-matrices. Here K(x, t; dy, dw) 
is a jump-kernel from K d+1 to itself, so that for every (x,t) G R d+1 , C 1— > 
K(x,t;C) is a measure on that is finite on sets bounded away from the 

origin, and (x,t) h4 K(x,t;C) is a measurable function for every Borel set 
C C R d+1 . The truncation function hi(x,t) = x l l{{x,t) e [-1, l] d+1 }. Since the 
sample paths of D u are strictly increasing, 7 > 0, the diffusive component of D u 
is zero, and the measures K{x, t; dy, dw) are supported on (dy, dw) el d x [0, 00). 
Instead of assuming that K(x, t; dy, dw) integrates 1 A |(y, w) || 2 , it then suffices 
to assume 

[l A (\\y \\ 2 + \w\)] K (x, t; dy, dw) < 00, V (x, t) G R d+1 . (2.6) 

The space-time jump kernel K can be interpreted as the joint intensity measure 
for the long jumps and long waiting times which do not rcscale to as c — > 00. If 
the measures (dy, dw) 1— > K(x, t; dy, dw) are supported on "the coordinate axes" 
(R d x {0}) U ({0} x [0, 00)), then long waiting times occur independently of long 
waiting times, and the CTRWL and OCTRWL are identical [38, Lem. 3.9]. We 
refer to this as the uncoupled case, and to the opposite CclSC clS the coupled case. 

Finally, we assume that the coefficients bi, 7, a.y and K satisfy Lipschitz and 
growth conditions as in [1, Sec. 6.2], so that (A U ,D U ) has an interpretation as 
the solution to a stochastic differential equation, as well as a semimartingale [16, 
Sec. III. 2]. Then for any canonical Feller process (A U ,D U ) on we define the 

CTRWL process X t = (A E% -) + , and the OCTRWL process Y t = A Et , where 
Et is given by (2.4). If we set A$- = Aq, then Et, Xt and Yt are defined for all 
t G K. 



2.1. Forward and backward renewal times 

Although the (O) CTRWL is not Markovian, it turns out that it can be embed- 
ded in a Markov process on a higher dimensional state space, by incorporating 
information on the forward/backward renewal times. Define the regenerative set 

M = {(t,co) Clx!l:i= D u (lo) for some u > 0}, 
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the random set of image points of D u . These will turn out to be the renewal 
points of the inverse process E t defined in (2.4). Since D u is cadlag and has 
a.s. increasing sample paths, for almost all w the complement of the w-slice 
M(w) := {£ G R : (£, u) G M} in R is a countable union of intervals of the form 
[D u -(u)),D u (u))), where u > ranges over the jump epochs of the process D u . 
For example, if D u is compound Poisson with positive drift, then M is a.s. a 
union of intervals [a, b) of positive length. If D u is a /3-stable subordinator with 
no drift, then M is a.s. a fractal of dimension j3 [7). 

For any t > 0, we write Gt, the last time of regeneration before £, and H t , 
the next time of regeneration after t, as 

G t (uj) := sup{s < t : s G M(uj)} < t < inf{s > t : t € M(w)} =: H t (w), (2.7) 

where for convenience we set Gt(to) = inf M(w) = t, P x ' T -a.s. whenever the 
supremum is taken over the empty set. In terms of the CTRW model, the particle 
has been resting at its current location since time Gt, and will become mobile 
again at time H t . It will become clear in the sequel that the future evolution 
of X t and Y t on the time interval [H t , oo) depends only the position Y t at time 
t = Ht, meaning that H t is a Markov time for X t and Y t . 

Note that Gt and H t are a.s. defined for all £ € R and their sample paths are 
cadlag. By our assumptions on D u and the definition (2.4), it is easy to see that 

G t - = D Et - and H t = D Et P x < T -a.s. 

The age process V t and the remaining lifetime R t from renewal theory can be 
defined by 

V t :=t- G t and Rt :=H t -t for all t G R. (2.8) 

At any time £ > 0, the particle has been resting at its current location for an 
interval of time of length Vt , and will move again after an additional time interval 
of length R t . We will show below that the processes (X t -,Vt-) and (Y t ,Rt) 
are Markov, and we will compute the joint distribution of these R d+1 -valued 
processes at multiple time points, using the Chapman-Kolmogorov equations. 
The joint laws of [X t -,Y t , Vt-,Rt) were first calculated in [9, 26], but only in 
the case where the space-time process (A u , D u ) is Markov additive (see Section 
4)) and only for Lebesgue-almost all £ > 0. We now calculate this joint law 
in our more general time-inhomogeneous setting, for all £ > 0. We need the 
following additional definitions: Let 

C = {(i,w) G R x n : D u _(w) = £ = D u (u) for some u > 0} G M 

be the random set of points traversed continuously by D u . The set C is obtained 
by removing from the set M of regenerative points all points £ which satisfy 
£ = D u > D u - for some u > (i.e. the right end points of all contiguous 
intervals). Moreover, since (A U ,D U ) visits each point in R d+1 at most once, it 



M.M. Meerschaert and P. Straka/ Semi- Markov Approach to CTRW Limits 



7 



admits a O-potential, or mean occupation measure, U X ' T defined via 



f{x,t)U x > T (dx,dt) =E*' T 



E x ' r 



f{A u ,D u )du 



f{A u _,D u ^)du 



T u f(x, T )du 



for any non- negative measurable function / : R d+1 — > [0, oo). The last equality 
holds because (A U ,D U ) only jumps countably many times. Since (A U ,D U ) has 
infinite lifetime, U X ' T is an infinite measure. We assume that D u is transient [10], 
so that U x ' T (M. d x I) < oo for any compact interval / C [0,oo). For instance, 
any subordinator is transient [7] . 

Next we derive the joint law of the Markov process (X t -,Y t , Vt-,Rt)- The 
proof uses sample path arguments, and we consider two cases, starting with the 
case {t £ C}: 

Proposition 2.1. Fix (%,r) G R d+1 and t>T. Then 



E*' T \f{X t -,Y t ,V t -,Rt)l{ttC}] 
U x > T {dx,ds) 

x£K d se[r,t] 

K(x, s; dy, dw)f{x, x + y,t — s,w — (t — s)) 

' w£[t — s,oo) 

for all non-negative measurable f defined on 



(2.9) 



td+l 



pd+1 



Proof. The complement of the section set C(w) in R is a.s. a countable union 
of closed intervals [D u -, D u ], where u is a jump epoch of D u . Hence for t £ C 
we have G t _ < t < H t and G t - < H t , hence AD Et = H t - G t - > 0. In the 
complementary case {t € C}, the sample path of E t is left-increasing at t, and 
hence the ^-optional time E t is announced by the optional times Et-\i n - Et is 
hence ^-predictable [21, p. 410] and since in our setting (A u , D u ) is a canonical 
Feller process, it is quasi left-continuous [21, Prop. 22.20], and A(A,D)E t = 
(0,0) a.s. Writing J = {(u,u) el + x!l: A(A,D) U ^ (0,0)} for the random 
set of jump epochs of (A U ,D U ), we hence find that 

f(X t -,Y t ,Vt-,Rt)l{ttC} 

= ^2 f{A u -,A u ,t- D U -,D U - t)l{D u - <t<D u } 



E 



f(A u ^,A u - + AA U , t-D u -,D u . 
1{D U - < t < D u - + AD U }, 



AD U - 1) 



noting that all members of the sum except exactly one (it = E t ) equal 0. The 
last expression equals J W (uj , u; x , s) fi(ui , du; dy , dw) for the optional random 
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measure 



n(uj,du;dy,dw) = ^ lj(v,u])6( vA ( Av ( w ) !Dv ( u ))(du; dy, dw) (2.10) 

v>0 

on du x (dy,dw) € K + x M. d+1 associated with the jumps of (A U ,D U ), and the 
predictable integrand 

W(u, u; y, w) := f{A u _ (u), A u - (w) +y,t- D u _ (w), Z>„- (ui) +w-t) 
1{-D U _H < « < £>„_(w)+«;}. 

The compensator [iP of /i equals [16, p. 155] 

fi p (io;du,dy,dw) = K(A u —(u>),D u —(uj);dy,dw)du. (2-11) 

Then the compensation formula [16, II. 1.8] implies that 

E* T [f(X t -,Y u V t -,Rt)l{ttC}] 



= E X ' T 



W(co, u; y, w)fi p (u), du; dy, dw) 

f(A u -(oj),A u -(u)+y,t-D u -(u),D u -(u)+w-t) 



oo oo 



^"=0 y£R d w=0 

1{D u ^{lo) < t < D u _(w) + w}K(A u -(oj),D u -(u));dy,dw) du 



OO OO 



□ 



f{x, x + y,t — s, s + w —t) 

l{s <t<s + w}K(x, s; dy, dw) U x ' T (dx, ds) 

which is equivalent to (2.9). 

The following proposition handles the case {t £ C}: 

Proposition 2.2. Fix (%, r) <G M. d+1 and t > r. Suppose that the temporal 
drift 7 is bounded and continuous, and assume that the mean occupation mea- 
sure U x,T (dx,dt) is Lebesgue- absolutely continuous with a continuous density 
u x,T {x,t). Then 



E*> T [f(Y t )l{t eC}}= f f(x)j(x,t)u x < T (x,t) 

Jx£M d 



dx 



(2.12) 



for all bounded measurable f. Also (2.12) remains true ifY t is replaced by X t - 
Y t -, orX t . 
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Proof. Similarly to the proof in [26] , D u admits a decomposition into a contin- 
uous and a discontinuous part via 

D c u = f 7 (A s ,D s )ds, D d u = V AD S , t>0. 

JO n^„^„ 



0<S<M 



To see this, we first note that {A u , D u ) is a semimartingale, and hence D u allows 
the decomposition 

D u = AD S 1{AD S > 1} + B u + M u (2.13) 

where B u is a predictable process of finite variation (the first characteristic 
of D u ) and M u is a local martingale. Due to [16, IX §4a] and (2.5), B u = 
Jq j(A s ,D s )ds where j(x,t) =j(x,t) + J sl{||(y,s)|| < l}K(x,t;dy,ds). Since 
D u has no diffusive part, M u is purely discontinuous and equal to M u = 
J2 s <u &D S 1{AD S < I}- ft J wl{\\(y,w)\\ < 1}K(A S , D s ;dy,dw)ds. But then 
(2.13) reads D u = D d u + D c u . 

For fixed oj, the paths of D, D c and D d are non-decreasing and define 
Lebesgue-Stieltjes measures dD, dD c and dD d on [0, oo). Then for any bounded 
measurable / and g we have 

/>oo 

f(A u )g(D u ) 1 (A u ,D u )du= / f(A u )g(D u )dD c u . (2.14) 

Jo 

The continuous measure dD c does not charge the countable set {u : AD U ^ 0} of 
discontinuities of D u and coincides with dD on the complement {u : AD U = 0}. 
Hence the right-hand side of (2.14) can be written as 

/ f(A u )g{D u )l{u : AD U = 0}dD u . (2.15) 
Jo 

The following substitution formula holds for all right-continuous, unbounded 
and strictly increasing F : [0, oo) — > [0, oo), the inverse i ?_1 (i) = inf{w : F(u) > 
t} and measurable h : [0, oo) — > [0, oo): 

/>oo 

h(u)dF u = / hiF^itydt. 



To see this, first show the statement for h an indicator function of an interval 
(a, b] C [0, oo) and then for a function taking finitely many values. The statement 
for positive h then follows by approximation via a sequence of finitely valued 
functions from below, and for general h by a decomposition into positive and 
negative part. Applying the substitution formula to (2.15) with F(u) = D u , the 
right-hand side of (2.14) reduces to 



poo 

/ f(Y t )g(H t )l{t : AD Et = 0}dt. 
Jo 



M.M. Meerschaert and P. Straka/ Semi- Markov Approach to CTRW Limits 



10 



Now note that AZ?£ t = is equivalent to t € C and implies H t = t. Hence the 
above lines show that the left hand side of (2.14) equals 

/>oo 

/ f(Y t )g(t)l{t 6 C}dt. 
Jo 

Take expectations and apply Tonclli's theorem to get 



f(x)-y(x,t)g(t)u x ' T (x,t)dxdt = / E x ' T [f(Y t )l{t e C}]g(t)dt. 

Since g is an arbitrary non-negative bounded measurable function, this yields 
(2.12) for almost every t. By our assumption that D u is transient, U X ' T (R d x I) < 
oo for compact I C [0, oo), and then it can be seen that the continuous function 
u x ' T (x,t) must be bounded on R d x I. Let I contain t and apply dominated 
convergence to see that the right-hand side of (2.12) is continuous in t. We 
have already noted in the proof of Proposition 2.1 that A(A,D)E t = (0,0) 
on {t £ C}, which shows the continuity of the left-hand side. This shows the 
equality for all t > 0, and also that X t - X t - = = Y t - Y t _ on {t e C}. □ 

We can now characterize the joint law of (X t _,Y t , V t -, i?t): 

Theorem 2.3. Fix (x, t) E and t > r. If 7 does not vanish, then sup- 

pose that the mean occupation measure U X,T (dx, dt) has a continuous Lebesgue 
density u x ' T (x,t), and 1/7 = 0, let u x ' T (x,t) = 0. Then 



E x < T [f(X t _,Y t ,V t -,R t )]= / f(x,x,0,0)j(x,t)u x < T (x,t)dx 

JxGM d 

U x ' T (dx,ds) 

K(x, s; dy, dw)f(x, x + y,t — s,w — (t — s)) 



/ 



j/GK d «j6[t— s,oo) 

for all bounded measurable f. Moreover, X T = Y T = \ an d Vt = Rt = 0, 
¥ x,r -almost surely. 

Proof. On the set {t G C}, Vt- = = Rt. The above formula then follows from 
Propositions 2.2 and 2.1. Assumption (2.2) and the right-continuity of D yields 
V T = R T = 0. The sample paths of E are then seen to be right-increasing at r 
and E t > E T = for t > r. The right-continuity of A together with Aq = x, 
P*> r -a.s. yields X T =Y T = X - □ 



3. The Markov embedding 



In this section, we establish the Markov property of the processes (Y t , R t ) and 
(X t -,Vt-). Since {E t < u} = {D u > t}, P*' T -a.s. for every ( X ,t) e R d+1 
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[29, Eq. (3.2)], we see that E t is an ^-optional time for every t. We introduce 
the filtration H = {Ht}tm where Ht = Te ± and note that (Y t ,R t ) is adapted 
to H. Moreover, if T is "H-optional, then Et ■ OJ i-> -Et(w) ( w ) is ^"-optional 
(see Lemma A.l). We define the family of operators {Q s j}s<t acting on the 
space Bb(M. d x [0, oo)) of real- valued bounded measurable functions / defined 
on R d x [0, oo) as follows: 

Q a , t f{y t 0) = W>'[f(Y t ,Rt)], 

Q s ,tf(y, r) = l{r>t- s}f(y, r - (t - «)) (3.1) 
+ l{0<r <t-s}Q a+r ,tf(y,0) 

The dynamics of Q s ,t can be interpreted as follows: If the process (Yt,Rt) starts 
at (y, r), the position in space y does not change while the remaining lifetime Rt 
decreases linearly to 0. When r = 0, the process continues with the dynamics 
given by (Y t ,Rt) started at location y at time s + r. Note that Q s ,tf(y,r) is 
measurable in (s,t,y,r), for every bounded measurable /, by the construction 
of the probability measures P x,r . We can now state the strong Markov property 
of (Y t ,R t ) with respect to H and Q s .t- 

Theorem 3.1. Suppose that the operators Q s t are given by (3.1). Then 
(i) The operators Q s ,t satisfy the Chapman- Kolmogorov equations: 

Qq,sQs,tf = Qq,tf, q < S <t, 

and moreover (J S; il = 1. 
(ii) Let (x, t) £ M. +1 } t > and let T be a H-optional time. Then 

&- T [f(Y T+t ,R T+ t)\UT] = Q T ,T+tf{Y T ,RT), ¥ X - T -almost surely 

for every real-valued bounded measurable f. 
(Hi) The process 1 1— > (Y t ,Rt) is quasi-left- continuous with respect to H. 

Hence (Yt,Rt) is a strong Markov process with respect to 7-L and transition op- 
erators Q s ,t- 

Proof. A proof is given in the appendix. □ 

We define the filtration Q = {Gt}t£R via Q t = J~E t -, the a- field of all ^-events 
strictly before E t . Evidently, the left-continuous process [Xt-,Vt-) is adapted 
to Q. The main idea behind the Markov property of (X t -, Vt~) is that, knowing 
the current state (x, v) = (X t ~, Vt_) and the joint distribution of the next space- 
time increment given by the kernel K (x, v; dy, dw) in (2.5), one can calculate the 
distribution of the next renewal time H t and the position Y t at that time. Then 
the probability of events after the renewal point Ht can be calculated starting 
at the point (Y t ,H t ) in space-time. We introduce the following notation: Define 
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the family of probability kernels {K v } v >$ on M. d+1 

K(x,t;Cn (M. d x \v,oo))) , ... 

K v (x, t; C) = V/ , ^ , 1 ' / , v > 0, x, t) G K d+1 , C C M d+1 
A (x, t; K a x [v, oo)) 

K (x,t;C)=S m {C) 

(3.2) 

where C is a Borel set. For v > 0, K v (x, t; dy, dw) is the conditional probability 
distribution of a space-time jump (y, to) (a jump-waiting time pair), given that 
a time-jump (a waiting time) greater than or equal to v occurs. Should the 
denominator K{x, t; R d x [v, oo)) equal 0, we set K v (x, t; C) = 0. If v = 0, then 
Kq is the Dirac-mcasure concentrated at (0,0) £ Since v H > K(x,t;C 

n R d x [v, oo)) is decreasing and hence measurable, it follows that v >-> K v (x, t; C) 
is measurable for every (x,t) G R d+1 and Borel C C 

We now define the family of operators {P s .t}s<t acting on the space B[ ) (M d x 
[0, oo)) of real-valued bounded measurable functions defined on R d x [0,oo): 

P s , t f(x,0)=E x ' s [f(X t ^,V t -)}, 

P s tf(x, v) = f(x, v + 1 — s)K v (x, s - v; R d x [v + 1 — s, oo)) 

, . (3.3) 

+ / / P s+w - Vtt f(x + y,0)K v (x,s-v;dy,dw). 



j/6R d wE[v,v+t—s) 

The dynamics given by P s ,t can be interpreted as follows. With probability 
K v (x, s — v; M d x (v + 1 — s, oo)), the process remains at x and the age increases 
by t — s. This is the probability that the size of a jump of D whose base point is 
at (x, s — v) exceeds v + 1 — s, given that it exceeds v. The remaining probability 
mass for the jump of (A, D) is spread on the set (y, w) € M. d x [v,v + t — s), and 
the starting point is updated from x to x + y at the time s — v + w. 

Theorem 3.2. Let P s>t be the operators defined by (3.3). Then 

(i) The operators (P s ,t) satisfy the Chapman- Kolmogorov property: 

P g , s P s ,tf = P q ,tf, q<s<t, 

and moreover P Sj tl = 1. 
(ii) The process (Xt-,Vt~) satisfies the simple Markov property with respect 
to Q and P s .t-' 

W> T [f(X t -,V t -)\g a ] = P s , t f(X s _,V s _), F^-a.s. 

for all (x, t) € r < s < t and real-valued bounded measurable f . 

Proof. A proof is given in the appendix. □ 
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4. The time-homogeneous case 

If the coefficients b(x, t),j(x, t), a(x, t) and K(x, t; dy, dw) of the generator A in 
(2.5) do not depend on t G K, then we say that (A u , D u ) is a Markov additive 
process. This means that the future of (A U ,D U ) only depends on the current 
state of A u , see for example [8] . 

Theorem 4.1. If the space-time random walk limit process (A U ,D U ) in (2.1) 
is Markov additive, then the Markov processes (Xt—, Vt_) and (Yt, Rt) are time- 
homogeneous. Writing K r (x; dy, ds) := K r (x, t; dy, ds) and W x = P x '° , the tran- 
sition semigroup Qt- S Qs.t of the Markov process (Y t ,Rt) is given by 

Q t f{y,Q)=W[f(Y t ,R t )\, 

Q t f(y, r) = l{Q<t< r}f(y, r - t) + 1{0 < r < t}Q t . r f(y, 0) 

and the transition semigroup Pt- S '■= Ps.t of the Markov process (Xt-,Vt-) is 
given by 

P t f(x,0)=E x lf(X t „,V t -)}, 

P t f(x, v) = f(x, v + t)KJx\ R d x [v + t, oo)) 

(4.2) 

Pv+t-wf{x + y, 0)K v (x; dw, dy), 

R d x[v,v+t) 

acting on the bounded measurable functions defined on [0,oo) x M. d . 

Proof. Since (A u , D u ) is Markov additive, we have i) s Af = Ad s f for all s£l, 
where the shift operator d s f{x,t) = f(x,t + s). It follows that the resolvents 
(A — .4)" 1 , the semigroup T u and the kernel Uf(x, t) = U x,T (f) commute with 
d s . Then E^ T [f{A u , D u )\ = W<°[f(A u ,T + D u )\ for all u and measurable /, 
and hence it suffices to work with the laws P x, °. Now in Theorem 2.3,writing 
U x ' T (dx,dt) = U x (dx,dt — t), we have 

EX' T lf(X t -,Y u V t -,R t )] = EX< {f(X (t _ T) _,Y t - T ,V (t ^,Rt-r), 

where r = without loss of generality. It follows that (4.1) and (4.2) are semi- 
groups acting on the bounded measurable functions defined on [0, oo) x M d , 
compare [15, Eqs. (19) and (31)]. □ 

Remark 4.2. Under the assumptions of Theorem 2.3, a simple substitution yields 
the formulation of Pt and Q t in terms of transition probabilities: For P t we find 

Pt{xo, 0; dx, dv) = j(x, t)u x ° (x, t) dx So(dv) 

+ K(x ;R d x [v,oo))U Xo {dx,t - dv)l{0 <v<t}, 
P t {x ,v ;dx,dv) = S Xo (dx)S Vo+t idv)K Vo (x ;R d x [v +t, oo)) 



P Vo+t - w {x + y, 0; dx, dv)K Vo (x ; dy, dw), 

y£R d we[v ,v +t) 

(4.3) 
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and for Q t we have 

Qt{yo,0;dy,dr) = -y(y,t)u yo (y,t)dy5 (dr) 

+ J J U yo (dx,dw)K(x;dy - x,dr +t - w), 
x£M d we[o,t] 

Qt(yo,ro;dy,dr) = 1{0 < t < r }6 yo (dy)6 ro - t (dr) 

+ l{0<r < t}Q t _ ro (y ,0;dy,dr). 

5. Finite-dimensional distributions 

In this section, we provide two examples to illustrate the explicit computation of 
finite dimensional distributions for the CTRWL process X t and the OCTRWL 
process Y t . 

Example 5.1 (The inverse stable subordinator). A very simple CTRW model 
takes deterministic jumps = c _1 and waiting times W£ in the domain of 
attraction of a standard /3-stable subordinator D u such that E[e~ s ^ u ] = e~ usf> . 
Setting (A ,D ) = (x,r), (2.1) holds with (A u ,D a ) = ( x + u,r + D u ), where 
D u is a /3-stable subordinator. Here the CTRWL and the OCTRWL coincide, 
since A u has no jumps. If (x> r ) = (0,0), then in (2.3) we have X t = Y t = E t , 
the inverse /3-stable subordinator. Now we will compute the joint distributions 
of this first passage time process. To our knowledge, this computation has not 
been reported previously in the literature. 

The space-time limit (A U ,D U ) is a canonical Feller process on M. d+1 with 
generator A given by (2.5) with d = 1, b\ = 1, 7 = 0, an = 0, and jump kernel 
K(x, t] dy, dw) = 5a(dy)&(w)dw by [31, Proposition 3.10], where the Levy mea- 
sure &(w)dw — f3w~ l3 ~ 1 dw/r(l — P). The stable Levy process D u has a smooth 
density g(t, u) so that P°'°(D U e dt) = g(t, u)dt for every u > by [17, Theorem 
4.10.2]. The underlying process (A U ,D U ) is Markov additive, hence (X t -,Vt-) 
and (Y t ,R t ) are time-homogeneous Markov processes. In [38, Lem. 4.2] it was 
shown that (X t , Vt), has no fixed discontinuities, hence (Xt-, Vt_) has the same 
law as (X t ,Vt). One checks that the 0-potential of (A U ,D U ) is absolutely con- 
tinuous with density 

u^ T (x, t) = g(t -t,x- X )l{t >t,x> x }. (5.1) 

Then it follows from 4.3 that the transition semigroup of (Xt—, Vt-) is given 

by 

Pt(xo, 0; dx, dv) = g(t — v, x — xo)$(v, 00) dx dv, 
P t (x ,v ;dx,dv) = S Xo (dx)S Vo+t (dv) ( — + 1 ) l{v Q > 0} 



f'o 



VQ+t — V 



/v \P f J3s 1 13 ds , 

{-) J g((t — v) - (s - v Q ),x - ,t ) _ ^ l{x > x ,0 < v < tjdxdv. 

S = l'o 

(5.2) 
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Hence for < t\ < the joint distribution of (E tl , V tl , E t2 ,V t2 ) is 

P°'°(£ tl £ dx, V tl 6 dv,E t2 € dy, V t2 E dw) 
= Pt 2 -ti {x, v; dy, dw)Pt 1 (0, 0; dx, dv) 
= g(h - v, x)$(v, oo)l{x > 0, < v < h}dxdv 

6 x (dy)6 v+ t a - tl (dw) ^— — ^ — —J 

V + t2 — ti —W 

g((t 2 -ti-w)-(s- v), y-x) 



fis-P^ds 

r(i-/3) 



/ v \P 

— dy dw l{y > x, < w < t 2 - h} 



since Eq = Vo = for the physical starting point (0,0). Integrating out the 
backward renewal times Vt 1 and V t2 , it follows that the joint distribution of 

(E tl ,E t2 ) is 

P(E tl e dx, E t2 e dy) 

= l{x > 0}S x (dy) £ g(t 1 - v, x) {v ^ ~ ^ dv 

tl pt-2-t! r V+t 2 -tl-W (5-3) 

g((t 2 -t x - w) - (s —v),y — x)dyl{y > x} 



v=0 J w=0 



Ps-^ds /v\P , , 
dw dv. 



(") 



r(i-/3) v w 

Remark 5.2. The joint distribution of (E tl ,E t2 ) can also be computed from 
the OCTRW embedding, but the computation appears to be simpler using the 
CTRWL embedding. 

Remark 5.3. Baule and Friedrich [4] compute the Laplace transform of the joint 
distribution function H(x, y, s, t) of x = E s and y = Et and show that 

(d x + O y )H(x, y, s, t) = -(d s + O t fH(x, y, s, t) 

on < s < t and < x < y. Equation (5.3) provides an explicit solution to this 
governing equation, which solves an open problem in [4] . The finite dimensional 
laws of any uncoupled CTRW limit can easily be calculated from the finite 
dimensional laws of Et, given the law of the process A u . This follows from a 
simple conditioning argument, see e.g. [29]. 

Example 5.4. Kotulski [24] considered a CTRW with jumps equal to the wait- 
ing times = Wu, in the domain of attraction of a standard /3-stablc subor- 
dinator D u such that E[e~ sDu ] = e~ usf> . Equation (2.1) holds with (A U ,D U ) = 
(Aq + D u , Do + D u ). The space-time limit (A U ,D U ) is a canonical Feller process 
on R d+1 with generator A given by (2.5) with d = 1, 7 = and K(x, t; dy, dw) = 
5 w (dy)§(dw), where $(dw) = <f>(w)dw = (iw^^^ 1 dw /Y{1 - /3). The stable Levy 
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process D u has a smooth density g(t,u) so that V 0,0 (D U £ dt) = g(t,u)dt for 
every u > 0. Since the Markov process (A U ,D U ) is Markov additive, we need 
only compute the potential for r = 0: 

/>oo 

U x '°(dx,dt) = S x+t (dx) g(t,u)dudt. (5.4) 

Next one sees that 

t f3-l 



g(t,u)du=-— (5.5) 

u=0 L \P) 

by taking Laplace transforms on both sides (also see [31, Ex.2.9]). The 0- 
potential hence equals 

U*'°(dx,dt) = 5 x+t (dx)^rdt. (5.6) 

With $([v,oo)) = v- p /r(l - f3), (4.3) reads 

(t - v) 13 ' 1 

Pt(x Q ,0;dx,dv) = ^ - ^ — — 8 Xo+t - v (dx) dvl{0 < v < t}. 



P t (x ,v ;dx,dv) = S Xo (dx)5 Vo+t (dv) 



v o+t / „, \ -P 



VQ±t 

vo 



s=v 



— o Xa +va+t-v\ax) — — 

«o/ r(/3) 



Bs' 13 - 1 

1{0 < v < v + 1 - s} ZTpj ds dv 

Note that the above formulae extend Example 5.5 in [23], which calculates 
the law of Xt-. The joint distribution of {(X^-, Vt 4 -) : < i < n) can now 
be computed by a simple conditioning argument. Similarly, the semigroup for 
{Y t ,R t ) reads 

Qt(y ,r ;dy,dr) 

= 5 yo (dy)S ro -t(dr)l{r >t} + Q t - ro {dy - y ,dr)l{0 <r <t} 
= 5 yo (dy)S ro -t(dr)l{ro > t} 

+ 1{0 < r < t}6 r+t . ro+Vo (dy) m ^ dwdr. 

The joint distributions of X t _, Y t lead directly to the joint distribution of 
CTRWL, OCTRWL respectively for a wide variety of coupled models, see [20]. 



Appendix A: Proofs 

Lemma A.l. Let T be %-optional. Then Et : oj i— > Ej-r u \{u) is J- -optional. 
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Proof. We first assume that T is single valued. That is, fix t > and U G Ht, 
and let T(ui) = t ■ l{ui € U} + 00 ■ l{ui ^ /7}. It is easy to check that T is indeed 
%-optional. Now {Et < u} = < it} n J7, and the right-hand side lies in T u , 
which follows from U <E Tit = 3~E(t) an d the definition of the stopped cr-algebra 
J~E(t)- Now consider an "H-optional time T with countably many values t n , so 
that Q = Utjgn{ w ■ ^X^O = Then due to the a.s. non-decreasing sample 
paths of E, we have -B(inf T n ) = inf E(T n ), and an application of [21, lem.6.3/4] 
together with the right- continuity of the nitrations T and TL shows that Et is 
H-optional. □ 

Stopping times allows for a decomposition into a predictable and totally 
inaccessible part [21]. The following lemma gives an interpretation for stopping 
times of the form Et ■ 

Lemma A. 2. Let T > be an Ji -predictable stopping time. Then the T- 
stopping time Et is predictable on the set {uj : Et- £ {u) < £ l j , (o;)Ve > 0} = 
{Vt- = 0} and totally inaccessible on the complement {uj : Be > 0,£T-e(w) — 
E t {oj)} = {V T - > 0}. Moreover, A{A,D) Et = (0,0) on {V T - = 0} and 
AD Et > on {V T - > 0}, F^ T -a.s. 

Proof. Let T n be an announcing sequence [21, p. 410] for T, that is T n are T-L- 
stopping times, T n <T,T n J [ T a.s. Then due to the a.s. continuity of sample 
paths of E, the sequence Et„ announces Et on the set {Vt- = 0}, that is 
Et is predictable on this set. As a canonical Feller process, (A, D) is quasi- 
left-continuous, and all its jump times are totally inaccessible [21, prop. 22. 20], 
hence A(A, D)e t = (0,0), P x ' r -a.s. on {Vt- = 0}. On the complementary set 
{Vt- > 0}, we have < Ht — Gt- = ADe t , and hence the process D jumps 
at Et. □ 

Proof of Theorem 3.1.. We first prove (ii) . Consider the set of ui such that 
H T (u) > t. In this case, M w n (T,t) = 0, and hence E T = E t , so (Y t ,H t ) = 
(Yt, Ht), which implies that 

E^[f(Y u R t )l {HT>t} \H T } = f(Y T ,H T -t)l {HT>t} 

= f(Y T ,R T -(t-T))l {HT>t} . 

This corresponds to the first case in (3.1). Turning to the second case, Ht(uj) < 
t, consider the shift operators 6t acting on J7, which are defined as usually by 
(9 t oj)(u) = ui(t + it), or equivalently 

(A, D) u (9 t uj) = (A, D) t+a (u), (A.2) 

since (A,D) is canonical for f2. Then from the definition of the inverse process 
E, we find 

E t {9 ET uj) = inf{it > : D u {6 Et lo) ><} = inf {it > : D u+Et {uj) > t] 

= inf {it : u - E t (uj) > 0, D u (u>) > t} - E t (uj) (A.3) 
= Et(u)-Er(u) 
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where 9 Et u> = 9 u ui if Et(uj) = u. Now observe that (A,D) Et is the point in 
M d+1 where the process (A, D) enters the set R d x (t, oo). This point will be the 
same for the space-time path started at the earlier time Et, that is 

(A,D) Et oe ET = (A,D) Et . (A.4) 

In fact, using (A. 2) and (A. 3) we find 

(A,D) Et (6 ET u)) = (A, D) Et (e ETUJ )(9E T u) = (A, D) ET ( u: )+E t {8 ET oj){u) 

= (A,D) Et{u) (uj) = (A,D) Et (uj) 

for all u! G fi. Hence we have shown that 

H t {6 ET u>) = H t (w), Y t (6 ET uj) = Y t (Lo) 

on the set {Ht < t}. This yields 

E^[f(Y t ,R t )l {HT < t} \H T }^E^[f(Y t ,R t )oe ET l {HT < t} \n T } 

= &- T [f{Y u R t )o6 ET \F ET ]l {HT < t} 

= m( A < D ^T [ f(Y u R t )}i {HT < t} (A - 5) 

= E Y T' H T[f(Y t ,R t )]l {HT < t} 

P x,r -almost surely, using the strong Markov property of (A, D) at the stopping 
time Et- Then (ii) follows by adding equations (A.l) and (A. 5). 

As for (i), let (y ,r ) G R d x [0, oo). Then Fy°> q+r °(Y r = y , R q = r ) = 1, and 
hence by nested conditional expectations and the above calculations we have 

Q 9 ,tf(vo,r ) = E^i+-o [Qqitf (Y q ,R q )} 

= E yo ' g+r ° [E yo - q+ro [f(Y u Rt)\H q ]} 

= E lJa - q+r ° \E yo ' q+ro {E Vo > q+r ° [f(Y t , R t )\n s ] \n q }} 

= E«°' q+r ° pE""^ [Q s , t f(Y s ,R s )\H q ]} 

= & a ' q+ro [Q q ,sQs,tf{Y q ,R q )] = Q g<s Qs,tf(yo,r ). 

We turn to the remaining case (iii). By definition of Rt, it suffices to show 
that if T is a "H-predictable time, then (Y,H)t- = {Y,H)t, P x,T -a.s. for every 
(x,t) G R d+1 . Hence let T n < T, T n t T be a sequence of ^-optional times 
announcing T. As in Lemma A. 2, we check the two cases in which the ^-stopping 
time Et is predictable or totally inaccessible. 

On the set {oj : Et- e {oj) < Et(oj),^£ > 0}, the process E is left-increasing 
at T, continuous, and E Tn t E T , E Tn < E T if T n \ T,T n < T. Moreover 
A(A,D) Et = (0,0) a.s. (Lemma A.2). Hence 

{H,Y) T - = (A,D) Et _ = {A,D) Et - = {A,D) Et = (H,Y) T . 

On the set {oj : Be > : Et- £ (uj) = Et(oj)}, E is left-constant at T. Hence 
Et„ = Et for large n, and 

(H,Y) T - = lim{H,Y) Tn = ]hn(A,D) ETn = {A,D) Et = {H,Y) T . 

The two cases together imply that (H, Y)t- = (H, Y)t a.s. □ 
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For the Proof of Theorem 3.2, we will need the following lemma. 

Lemma A. 3. Let (Xi T ) 6 and let t > r. Then for every bounded mea- 

surable f defined on R d+1 x we have F x ' T -a.s.: 

E^[f(X t -,G t .;A(A,D) m )\g t ] 
= J K Vt _(X t -,G t -;dx x dz)f(X t -,G t -;x,z) 

Proof. Since (A t _, C?t-) arc C? t -mcasurable, by a monotone class argument and 
dominated convergence, it suffices to prove the formula 

E*< T [f(A(A,D) m )\g t ]= J K Vt _(X t _,G t ^f) (A.6) 

for all bounded measurable / defined on R d+1 . As in Lemma A. 2, we consider the 
two cases {V t - = 0} and {V t - > 0}. On {V t - = 0}, we have A(A,D) Et = (0,0), 
P x ' r -a.s., and hence 

E^[f(A(A,D) E(t) l{V t - = 0}|ft] = /(0,0) 

- S(o,o) (/) = K Vt _(X t -,G t -;f)l{V t - = 0}. 

On {Vt- > 0}, the process D jumps at E t (Lemma A. 2), and since D has 
increasing sample paths this is equivalent to 

"there exists a unique number s > such that D s - < t < D s ." (A. 8) 

We rewrite the restriction of (A.6) to {Vt- > 0} in integral form: 

E^[f(A(A,D) m )l c l{V t ->0}] 
= W' T [K Vt _(X t -,G t -;f)l c l{V t ->0}], CgQ u 

where lc(w) = 1 iff u € C. Now we invoke [11, Theorem IV. 67(b)] which says 
that there exists an J-"-adapted predictable process Z such that lc = Z E ^ t y 
Then it suffices to show that for every ^-adapted predictable process Z, the 
following two random variables have the same expectation with respect to P x,r : 

f(A(A,D) m )Z m l{V t ->0}, K Vt _f(X t _,G t -)Z m l{V t ->0}. (A.9) 

We begin on the right hand side and find, using (A. 8) and Xt- = A Et -, Gt- = 
D Et - 

E*< r [Kv t _{Xt-,G t -;f)Z Et l{Vt- > 0}] 
= E*< T [K t - DEt _(A Et -,D Et -;f)Z Et l{DE t - < *}] 



E x '' 



^2 K t -D,- (A S -,D S _ ; f)Z s l{D s - <t<D s } 



s>0 



J2K t -D B -(A s -,D s _; f)Z s l{D s - < t}l{AD s > t - D s _} 



s>0 

l x ' T [W(-, s; y, w)/j,(-, ds; dy, dw)} 
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Where the optional random measure fi is as in (2.10) and 
W(u,s',y,w) 

= K t _ Da _ H [A s -(uj),D s .(ij); f)Z(a,u)l{D a -(u) < t}l{w > t - D s _(lu)} 

is a predictable integrand. The compensation formula [16, II. 1.8] and (2.11) then 
yield 



E* T [W(;3;y,w)n p (;ds;dy,dw)] 



= E x < r 



K t -D..(As-,Da-;f)Z a l{D.-<t) 



K (A 3 - , L> s _ ; M. d x (t - D s - , oo)) ds 
Using the definition of K v (3.2), this equals 

oo 

J J K(A s _,D s -;dy,dw)f(y,w)Z s l{D s -<t}ds 

R d x[t-_D s _,oo) 



= E x ' r 



OO 

J J K(A a -,D s _;dy,dw)f(y,w)Z s l{D s _<t<D s _+w}ds 



L0 Rd+l 

Proceeding similarly with the left-hand side of (A. 9), we find 
W< T [f(A(A,D) E{t) )Z E(t) l{V t - > 0}] , 



(A.10) 



rx> T 



5^/(A(A,D) a )Z s l{U 8 _ < t < D s - + AD S } 



s>0 



= E x,T [W(-,s; y, w)/i(-, ds; dy, dw)] 
= E^ T [W(;s;y,w)^(;ds;dy,dw)} 



(A.11) 



where W(w,s;y,w) = f(y,w)Z s (uj)l{D s ^(uj) < t < D s _(w) + w}. We check 
that (A. 11) and (A. 10) are equal. Hence we have shown 

E*' T [f(A(A > D) m l{V t ->0}\g t ] =Kv t _f(X t -,G t -)l{Vt->0}, (A.12) 

and adding equations (A. 7) and (A.12) yields (A. 6). □ 

For later use, we note the formula 

K v+t (x,z;C)K v (x,z;R d x[v + t,(X))) 
= K v {x,z;C), {x,z)eR d+1 , v,t>0, 

valid for all Borel-sets C C R d x [v + t, oo). 
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Proof of Theorem 3.2. Wc begin with statement (ii). We consider the two cases 
H s > t and H s < t. On the set {H s > t}, E is constant on the interval [s,t], 
and hence we have (G, X) t - = (G, A) s _. Using G s _ + AD Es = H s and Lemma 
A. 3, we calculate 

&> T [f(x t _,v t -)i{H s >t}\g s ] 

= f(X s _,t - G.-)W< T (H t >t\Q„) 

= f(X s _,t- s + V s -)F*' T (AD Es > t - G.-\g.) (A.14) 

= f(X s .,t - s + V s -)K Vs _(X s -,G s -;[t - G s -,oo) x R d ) 

= f(X s -,V s _ + t - s)K Vb _ (X s _,s -V.-)[t-a + V a -,oo) x K d ), 

which corresponds to the first summand in (3.3). 

We now turn to the case H s < t, and recall the shift operators 8 t from (A. 2). 
For the left-continuous version of (A, D), we can write 

{A,D) t _(O s Lu) = (A,D) s+t _(u), s > 0, t > 0; 

Note that we had to assume t > above, for the left-hand limit to be defined. 
Wc find now, similarly to (A. 4), 

(A,D) Et -oe Es = (A,D) Et - 

on {H s < t}. Indeed, by (A.3), E t (uj) = E s (lj) + E t (6 Et uj), and so 

(A,D) Et -(6 Ea u) = (A,D) Et (o Ba u)-{9E s u) = {A,D) Es ^ +Et ^ E ^_(uj) 
= (A,D) Mu) _(cj) = (A,D) Et _(w). 

If t > and H s (u) < t, then by (A.3) E t (6 Es u)) = E t (u) - E a (u) > 0, and the 
left-hand limit is well-defined. Thus we have shown that on the set {H s < t} wc 
have (Xt~, Vt-) = (Xt~, Vt_) o 9 Es . We will use the strong Markov property of 
(A, D) in the following form: 

E x ' r [Fo6 T \T T ] = E At ' Dt [F], P x ^ T -a.s., 

valid for all all ^-stopping times T and random variables F on (f2, J 7 ^, P X ' T ). 
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Using Lemma A. 3 and the strong Markov property at E s , we then calculate 

w> T [f(x t _,v t _)i{H s <t}\g s ] 

= E^ T [E^{f(X^,V t -)o8 Es \H s }l{H s < t}\g s ] 
= E x.r [E Y *' H *[f(X t _,V t ^)}l{H s <t}\g s ] 
= W c,r ^ x ' G ^- +A ^ D ^slf i x t ^,V^)]l{G^ + AD Es <t}\G s 

K Vs -(X s -,G s -;dy x dw) (A. 15) 

E ( x >v»-+(y> w )[f(x t _,v^)}i{G 8 - + w < t} 

K Vb _ (A s _ , s - V s - ; dy x dw) 



R d x[V a -,V a -+t-s) 

E x >-+y' s - v »-+ w if(x t _,v t -)], 

which corresponds to the second summand in (3.3). Adding equations (A. 14) 
and (A. 15) yields statement (ii). For statement (i), we calculate 

P r , s P s ,tf(x,v) = P s>t f(x,v + s - r)K v (x,r- v;R d x [v + s - r,oo)) 
+ J K v (x,r-v;dyxdw)E x +y> r - v+w {P s , t f(X s _,V s _)} 

R d x[v,v+s-r) 

= K v (x, r - v. R d x [v + s - r, oo)) 

|/(x,w + t-r)A" t , +s _ r (x,r-s;IR <i x [v + t-r, oo)) 

+ J K v+s „ r (x,r-v;dyxdw)E x+ y- r - v+w [f(X t „,V t -)]\ 

M d x[v+s~r,v+t-r) ' 

K v (x,r-v;dyxdw)E x+ y' r - v+w [P S)t f(X s _,V a .)] = ... 

R d X [v,v+s — r) 

Using (A. 13) and applying the statement (ii) with (\, t) = (x + y, r — v + w) 
yields 

. . . = f(x,v + t- r)K v (x,r - v;R d x [v + t - r, oo)) 

K v (x,r- v-dy x dw)E x+ ^- v+w [f(X^,V t .)\ 

1 X [v-\-s — r,v-\-t— r) 

K v (x,r-v;dy x dw)E x+ v> r - v+w ^E x+v ' r ~ v+w [f(X t _, V t -)\G a ]] 

R d x[v,v+s~r) 

= P r ,tf(x,v), 

which is statement (i). □ 
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